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. and thoughtful critique 


PREFACE 
we : 
The Second Career Education Natich al Forum, held in 


Washington, D.C. in February 1976, way evidence of The Center’s 
continuing commitment to research arid development i in career _ 


education. Prominent researchers and Academicians were joined 


by leading practitionérs i in‘a second nftionwide effort to share 
ideas, research, and opetational progyams in career education.’ We 


_are hopeful that this exchange will Ifnd insight to and impact upon 


future developments at féderal, state and local levels. Corinne 
Rieder, Associate Diréttor of the MIE Education. and Work Task 
Forcet and I look forward to planfing and organizing the Third 
Forum~with hope that the intergst and dedication of career edu- 
cators will again form the foundAtion for stimulating discussion 


a 


The Center’ is indebted tp the National Institute of Baucation, 
sponsor of the Forum, for it support and advice in Forum plan-- 
ning. We also appreciate thé time and efforts of those bres piers 
who shared their insights vith us all. ; 


+ This monograph sey (es includes Forum Bennie presentations 
and additional papers : ff yom distinguished lectures presented at the 
Forum. 
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The Ohio State/ Nnivarsity and The Center are proud to share _ 
: these papers with ypu. 


/ Robert E. Taylor 
A Director 
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irth believer in evaluating énsidaproving the effec- 
tiveness of educa\ion programs and making education more ac- 
pts, parents, and taxpayers. 


« A native of Mite eapolis, Minnesota, Dr. Hodgkinson joined, 
~ NIE from the Center lor Research and Development i in Higher 
‘ Education at the University of California, Berkeley, ee he had 


been a research educatol for seven years. 


Previously, he was Déan of the College at Bard College in New 
York from’ 1962-1968 and Nirector of the School of Education at 
Simmons College in Boston, \ 958-1961: 


; As Director of NIE, Dr. Hddgkinson heads a federal agency of 
some 350 persons with an annual\budget of about $80 million. 


He helped finance his education at the University of Minne- 
sota by playing with a jazz combo. His B.A. degree was awarded in 
_ 1953. In 1955 he earned an M.A.T. degree at Wesleyan Univer- 
sity; igen in the sociology of education was awarded by 4 
Harv iversity in 1959. i 


Like President Ford, who nominated him to be NIE Director 
on April 5, 1978; Dr. Hodgkinson i is an avid swimmer. He taught 
lifesaving for many years. ' P) 
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. His womination was confirmed by the U.S. Senate.on May 
. 8, 1975, and he was sworn in as Director of the Institute on May 
on ai . 
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The author of eleven books an American education, Dr. 
Hodgkinson is a former editor of the Harvard Educational Review 
anda special contributor to the Chronicle of Higher Education. 


__ He directed.the Institutions in Transition study for the 
Carnegie Commission, 1968-1970, and was director of a study 
: . developing institutions for the U.S: Office of Education, 1970- 
1S; _ i 


Dr. Hodgkinson was president of the American Association 
for Higher Education, 1973-1974, and is a charter member of the 
American Association of University Administrators. a { 


The Center for Vocational Education and the National | . | 
Institute of Education are proud to share with you Dr. Hodghinson’s 
presentation, ‘A Research Agenda for the National Institute of ‘ ; 
Education.” ; ‘ : 
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A Research’ Agenda for the 
National Institute of Education 


Harold L. Hodgkinson 


Background—NIE Resources 


? ga 
_ In “setting the scene” for a discussion of the National 
Institute of Education’s research agenda, I think it would 
profitable to previde some background about the U.S. infestment 
in educational research and development. The federal government 
spends approximately $511 million on educational research, devel- 
opment, dissemination and evaluation. In approximate figures, the 
states spend $40 million; the private foundations spend $57 million; 
and locajities spend $4 million. Though we don’t have adequate 
‘current data on local expenditures, I suspect that that figure is rising 
rapidly. From ail sources, then, the best estimate is that about $617 
million is spent in the United States for educational research and 
+ gdevelopment.* This expenditure compares to $116 billion which is : 
, the best estimate of the total expenditures for education from all: . 
sources in the United States; a relatively small proportion. 


: It is interesting to compare the budgetary expenditures itf6ur 
~ "field with comparable. ones for medicine and agriculture. No 
only do these fields spend a far higher amount in their total ‘for 


«  Tesearch, development, dissemmation and evaluation than we, they. 


*A low estimate is about $500 million; the high is about 
$790 million. 4 


by 


ee ee afar longer ites of-federal support of research da lee: 
opment. People from the. Department of Agriculture are always 
noting, “In ’61 we did this,” or ‘in ’65 we did that,” and it turns 
’ out they’re talking about 1861 and 1865. The Department has ~ 
4 100-year history of federally sponsored research dealing with ' ! 
+ agriculture. Comparatively, educational research is recent. The : 
: , Cooperative Research Act, after all, was passed in 1962, And,’ ie 
' unfortunately, though we’re relatively new on the scene of ee 
" -major federal investments, people are expecting the equivalent: 
-¢ of the cancer immunization shot or landing a man on the moon ; 
after very little solid, consistent federal effort. The amount of / 
_’ ‘money being spent on educational R & D, compared to the total , 
bas: national investment in education, can only be described as “ 
. | 
| 
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. . Th National Institute of Edndstion has an authorized bud- 
.” get for FY °76 of $59 million. Figure 1 shows the total Alonation 
of funds for FY 74-77, by progtam. < 
4 : 
. Asis evident in Figure 1, the diigseminetion portion of the 
NIE budget has increased considerably. Our goal is to provide 
money to state and local ~ cies so they can build their capacity; 
to get the results of newly developed products into the hands of 
people who can use them. 


. Basic Skills, a program in which we put a great deal of time 
and effort, is producing research results on early reading skills in 
children, as well as some new thinking about information process- 

* jing in grades four through six. Educational Equity’s increased al- 
location will be earmarked for bicultural and bilingual studies, 
which, thanks to Lau v. Nichols,“is an area of enormous impor- 

‘ tance to our society as a whole. 


a Education and Work’s budget has remained relatively con- 

_ stant. The slight downward trend is due primarily to the phasing 
out of one major project. There will, actually, be more free money 
~ for new and excitingalevelopments i in Education and Work than 


. there has been in the past. | 
2 oe 
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NATIONAL INSTITUTE OF EDUCATION 


Percentage Allocation of Funds by Program 
FY 1974-1977 
($i in millions & %) 


ADMINISTRATION & 
IN HOUSE RESEARCH 


SCHOOL CAPACITY BUILDING 
For PROBLEM SOLVIN 


11%/$10.1] EDUCATION & WORK 


11%/$9 5 J EDUCATIONAL EQUITY 


21%/$19 2] BASIC SKILLS 


189/816 2] DISSEMINATION 


1976 


FISCAL YEAR® 1974 


‘ TOTAL* $76 


‘| + explore those fundamental questions underlying our activities. | 
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Finance and Productivity deals primarily with effective and 


_ effictent ways of delivering new kinds of education to new popula- 


tions.- We support the ATS-6 satellite program and the University 
of Mid-America, two non-traditional and rather radical approaches 
to delivery. : 7) * 


_ Finally, School Capacity for Problem-Solving, one of the 
more interesting ideas, is based on the notion that every school and 


* gchool system has the capacity to improve itself. The NIE’s role 


is tohelp those school systems become more autonomous and more 


- capable of improving. This notion will also be applicable to colleges 


‘and universities, although we do not yet have such a program. 


Most of our.overall effort has been in elementary and second- 
ary education; however, the post-secondary segment will be ap- 
proximately 10 or 11 million dollars next year. We have invited a 
distinguished educator, Wilbert McKeachie, president-elect of the 
American Psychological Association, to spend a month as visiting 
seholar at the NIE to help us organize the programmatic elements 
of this post-secondary thrust. 


Note a rather interesting point: although the total budget 
figure is up slightly fog ’77, the proportion of money that is spent 
on administration, primarily salaries and expenses, ‘is actually a 
smaller proportion of the total in ’’77 and ’76. 1 think we’re the 
only agency in the federal government that said we could adminis- 
tera larger budget with the same-number of staff than we had last 


year. That’s heresy in Washington. 


Where do we spend our research money? Figure 2 shows 
the breakdown of funds in four areas: basic research, policy Boe: 


studies, developqent and dissemination. As Figure 2 indicates, 


basic research has been systematically inereased, and it’s our policy 
to try to increase it even further as we learn more about how to 


The Instityte’s allocation for policy studies has also, increased, and 
, 10 ° : 
4 ; - 
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- NATIONAL INSTITUTE OF EDUCATION. 


Allocation of Funds by Type of Ravelnaly Activity 
FY 1974-1977 ‘ 
* (Sin millions & %). 
J 


BASIC RESEARCH 


FISCAL YEAR 1974 5 976 1977 
TOTALPROGRAM $65 . $59 879 


Estimated allocation of funds by type of research activity for NIE.pro:. 
gram groups—fiscal year 1976 hs 
Dissemination and Resources—87~ dissemination 
Basic Skills—307 basic research and 60% development 
Educational Equity—847 development and 8‘~ research ; 
« Education gnd Work—66°: development, remainder in dissemination 
and research " : 
Finance and Productivity—66% development * 
School Capacity fortProblem Solving~33'+ basic fesearch, 40° devel 
opment, 8% dissemination 


, 


we * Less than 5% 


~ is now at a6% level. This figure does not include some of the 
‘congressionally mandated studies, such as the study of compen- ‘' 
satory education dnd also the study of school violence. Congress 
has suggested that we undertake certain major studies for them, 
and I agree that one of the functions of the Institute should be to 
provide the Congress with policy evidence which will enable them | 
to writé better legislation in the future: : 


What are the dimensions of American social, political and 
economic existenée we should consider in developing an agenda . 
for educational research?. There are two publications on this topic 
which I consider almost biblical in importance. The first one is: * 
(called The Condition of Education published by the National - 
Center for Educational Statistics. This book, I think, contains ‘hd 
‘most complete account of how education meshes with the needs . 
of society. The second one is really becoming biblical if it isn’t 
actually—it’s called Social Indicators 1973 published by the 
Office of Management and Budget. It tells more about the Ameri- 
can public population than an average layman might be interested 
in knowing. It covers population data, health, public safety, educa- 
tion, employment, income, housing, and leisure and recreation. 
What is amazing about these statistics is the way they, are begin- 
ning to dovetail: the way in which patterns are beginning to emerge 

‘about the American population as a whole. 


An Agenda for Educational Research 


In terms of the phenomena that we ought to consider it is 
essential to understand that some factors are beyond our control, 
but we nevertheless have to take them into account when examin- 

‘ ving the efficiency or effectiveness of the educational system in this 
country. 


Perhaps an example will clarify this notion. In December 
1975, Robert Livingston, a neuroscientist at the Univérsity of” 


; ; SAN 


wes : a F 
oy ifornia, San Diego, arinounced that the results of a recent 
study indjcated that more than a million children under age four 
: = in the United States have stunted brain growth due to malnutri-- 
i; * ion. The average deficit i in brain-size for children ‘below the. 

-* poverty level ls about 125 grams below the normal'size.of 1400 
is 1 grams, Livingston, also estimated that 60% of all pregnant women 
«  ,..at or below the poverty line were suffering from malnutrition = 

. - serious ancuEn ta damage their babies, and he concludes: ' 


vt corresponding proportion of the difficulties children 
experience in school and later in their career develop- rs 
ment may be due.to undernutrition affecting their 
aa growth i in uteral development and during an: 
e. 


“9H 


Ee The fact that nina poeta can be wered ar forces like 
nutrition have important implications for what we can and cannot 
ask the schools to do. No school, no matter how excellent, will’ 
be able to give the child from a poor background his 125 grams © 

;, of brain weight back. Just as the search for a cure ‘for cancer is * i 
”.. shifting toward greater interest in environmental factors associ- 
, ated with carcinogens, so we also must-begin examining.the en- 
‘vironmental factors that may ‘be Ifmiting the human potential of 
our students and, ultimately, our work force. As we think about .. 
more integrated social’ policy, it may be that the best policy deci- ° - 
* sion we could.make as a nation regarding education would be to © 
diet sure mia every pregnant woman has an adequate nutritional - 
iet 2 ; 


we | 
Population Trendy 


Ls Pe, 4 A serious ‘analysis of population Sandi is ‘imperative in _ 
~ considering a research agenda. As'sh iM Figure 3, we are still 


eo “ HLvingston, R.B.; ; Calloway, D: H:; MacGregor, J. s. Fisher, 

I G.J.; Hastings, A.B. “Y, S. Poverty Impact on Brain Development 

in Growth ahd Development of the Brain,” chapter from the book - . 
.. «Growth and Development of the Brain, M.A.B. Brazier, ed,; Raven 

"ey as New York, 1975 5, pp. 377-394 > = ' 
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_.” PERSONS 18-21, YEARS OLD 
"(IN THOUSANDS) 
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BUREAU OF CENSUS, 1973 


" ona slight increase in terms of the number of people in the 18-to’ 
21-year old category, but in 1980 those numbers begin to go down, 
and they go down\i ina rather sharp fashion: a 


‘We are literally running out of young people. You have been 
told that before, but here is something that I don’t think you have 
been told. If you look at where the decrease is coming, as desig- 

~ nated in:Figure 4, you will find that, in terms of the;total birth 

population in} 960- 72, it is primarily the Caucasian birth rate 
‘that has shown that decline. In this particular case, for example, 
most of the total decline comes from the Caucasian sector, but if” 
you look at minority births from 1960-72, the line remains re- 
markably straight. That means that there is a higher percdntage 

. of the births in 1972 among minority groups—20 percent com- 
pared to:15 percent, in 1960: The numbers have not changed,,. 
but the proportion of births in minority groups has gone up sig- 
nificantly. F 


' ‘ 


Illustrating the ditvation is Figure 5, taken from Social 
Indicators 1973. It illustrates.the situation vividly, showing a 
downhill roller coaster line representing the number of 18-year- " -» 
olds ‘who afe white, and a steady, only slightly declining line, 
representing’‘the number of 18-year-olds who are black. The per- 
centage of F8-year-olds who are black goés to 12 percent in 1965, 
to 18 percent by 1985. If you add all the minority groups in the« 
_ 1985 data, it:does look as if the 18-year-old cohorts by that time 
will be soniething like 30 percent from minority background. 
These are terribly important statistics when you think about 
the job of ealiration, Py 


\ 


In addition to having a declining number of 18-year-olds, we 
have a higher percentage of those people who come frqm back- — 
grounds which don’t work terribly well in conventional educa- 
tion settings. It seems then, that we have a large mission in terms 
af providing adequate education and adequate transition from 
education to work for that particular segment of the population. 
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Total Births 
4,258,000 


Caucasian Births i Total gis . ; Le ae 
whi 3,718,000. | va 
3,601,000 , oe. 


Caucasian ~ 


& 
4 & ; P 
a . 3,078,000 ; i: 
be Ne a She ‘ . 
> an is ~ Caucasian 
2 \ : Pee * 2,600,000 
’ g . ; ; 
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Minority Births Minority F « 
Minority 
657,000 . ” 640,000 
os (17.2%) 635,000 
‘ (20%) 
Go60 2 1970 1971. 1972 


Figure 4 
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One of the promises we eduéators have always made to 
people is ‘Come to us and we will make you rich.” If you look 


* at income data in Figure 6 (this is for 1969; income data for some’, 


reason takes four years to get together), comparing people with seh a5 
four years of high schookend those with four years of college, — 
you do find that college graduates made more money but in the 


- 60% range you cannot tell from the level of income how many: 
_ years of education a person has had. If you’subtract doctors and 


lawyers from this group, it virtually removes the advantage. © 


‘It is important to realize that the person who goes to college 

still makes more money, but the amount of increase is less than . 
it used to be. Figure 7 shows that in 1970 high school graduates 
were making about $8,000 per year, and in 1972 they were mak- 
ing $9,500, reflecting an increase of $1,000. During the same 
period, college graduates went from $11;100 to $11,500 for a 

rand total of $400 increase. College graduates still make more 

an people who have high school | diplomas, but think of the 
life style in 1972 that you could carry on for $11, 100‘compared 
to the life style you could carry on for $11,500, Let’s discuss ’ - 
some data, not yet published, which is an attempt to correlate 
lifetime earnings based on two factors: years of higher education, 
and the choice to join or not to joifi’a labor union. The data thus 
far supports the notion that if you want higher earnings over 
your lifetime, the thing you can do is to join a labor union 
as quickly as possible. That is something to think about. 


This trend is not‘necessarily bad, but it must be Tecognized. 
Street cleaners in San Francisco, for example, ‘make $13,000 a 
year while assistant professors in the state college system make _ 
$11,000. Look what street cleaners do. They do a very impor- 
tant job nobody else wants to do, and Glark Kerr once said that 
it may be wise to get used to paying people more to do disagree- 
able jobs that, must be done, and that we don’t want todo. That 
may be painful to think about, but it is also rather interesting. 


_ All-you have to do is compare a teachers’ strike with the garbage 3 


sollectors’ strike, and I think the point-is clear. 
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TOTAL MONEY INCOME IN 1969 
| AGE 35-44 


PERCENT OF 
POPULATION WITH 4 YEARS 
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OF COLLEGE OR 
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a * 
» INDISTINGUISHABLE 
/ 60% » 
01 23°43 6 7 -8-& 101112135 1415 18 1718 19" 
INCOME (In Thousands of Dollars) 
. Figure 6 ; / 
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US. YEARLY INCOME LEVELS , 


AGES 25:34» 
o (MALE AND FEMALE), 


1970 1972 , INCREASE 


High School Grads: . Y os ts 

$8,377 $941 /  +sip74 
College’ Grads: : A oe 
$11,133 <*.% $11,559 +$ 420 


(From Stanley Nollen, Gesrescown ied 
December 1973) ; 
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. Issues Related to Education wo Work 


“The Orgonizaional Svsteni 

oes, ‘Now, in relation to education ‘id work, I’d like to present. 

a metaphor that may be useful in setting’a context. When we ‘¢ 

‘ normally think about a cafeteria, we envision the system shown \ 

in Figure 8. A person enters the line, goes through’the system 4 

and leaves. It’s what systems people call a linear one-way bounded 

. system. Once you get in it, you can’t get out of it, and you must * 
go one way. There are some fascinating pa (hee between the 

ty cafeteria system and the education and wotk system. We've 
“usually thought, in America, that a person first goes to school, 

then goes to work, and then retires and has leisure, usually when 

he she is too old to.enjoy it., This notion pervades our thinking 

about schooling, too. If a person drops out for a quarter, that. 

person is considered a default and, therefore, somewhat immoral. 

‘We consider the person to be dead as far as higher education is 

concerned. This model of the cafeteria is very much the way we 

consider pivextion still, and the way we consider work, still. 
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“make yours, and in addition, yoo can’t go back. If. yk make a 


Now there's a new version of cafeteria management, and 
about 400 cafeterias in the United States are now operating in 
this mode. It’s called the scamble or random access system 


_(Figure 9). Once you enter into this arena, you are free to go 


wherever you want, pick out the méal you want, and leave. It 


« looks like absolute chaos, but the amazing thing is that this sys- 


tem-is about 20 percent more efficient than the Jinear system for 
avery simple reason. In the one-way line, you are forced to go-by 
much that you may or may not want. - You also have to wait for . 

the person ahead‘of you to make his/het decision before youcan  -y 


mistake you just have to deal with it for the rest of y 
: This second model ih an enormous amount of fl 
on the bart of the pure 


life. 
lity 


when this system was presented to a group of cafeteria. . 


“managers for their judgment, there: ‘was a very interesting response. 


Almost everyone said, “It’s immoral.”” And when the people were 
quizzed to find out what they meant by that, their response was 
fascinating. They said, “We set-up the line so you buy the good 


~ gtuff first, before you get to the desserts, by that time you don’t 


have any room gn your tray. You are protected from yourself. 
With the second pattern,” said the cafeteria managers, “‘the 
people will take nothing but desserts." And I thought about. 
Cotton Mather, Max Weber and the John Calvin version of the 
Protestant ethic. ,Jf cafeteria managers assume that people are 
inherently evil, I wonder what educators think. It occurred to 
me that educators. would probably think the same thing about ,; 
this system; that is, if you take English 101, naturally you ought 
to take English 201, and then English 301 and 401. The question 
of whether English 401 is at a different inherent level of difficulty‘ 
compared to English: a a question that is seldom asked. 


So, as we think abolit delivery goods and services, we have 
to remember that, though in education and in the world of work, —. 


goods and services have heen delivered in this linear fashion in the 


fe. acti» of gy 
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Figure 9 
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- past, but they will in the future be delivered in a random. access 
.? way. This will cause major changes in our.view of organization, 
both of education and of the world of work. Lifelong learning is 
, just one example of this flexjble cafeteria. The proponents of life- 
* long learning argue that a ci is inherently eligible for any 
+ education he/she wants, at any time during his/her life. Clearly, 
. jit’s difficult to adapt lifelong learning needs to the linear, 
bounded education system. ~ Pe 


Judicial Influenge 


. . In addition to those organizational factors, we are finding, 
increasingly, that the courts are delving into the relationship 
between educational degrees and the world of work. Griggs v. 
Duke Power, in.m inion, is a landmark decision. ‘It is the 
first time the courts have ordered that an.educational degree or 
a diploma can be used as a prerequisite for job applicancy if it | 
is proven that only people who have-earned that degree or 
diploma can do that job well. The Griggs decision has an enor- 
mous number of implications which we ought to take seriously. 


, { ‘ are 
Armstead v. Darkfield District involves a public school 
teacher who did not have a masters degree and she was, there- 
fore, not given tenure. She took the case to court arguing that 
it was up to the school district to prove that people who have 
M.A degrees teach better than people who don’t, and that’s a 
gloss case to prove. Similarly, this year two faculty mem- 
rs in teaching-otiented colleges, who have been denied tenure 
because they lack a Ph.D., have taken their case to court on the 
grounds that it is up to the college to prove that people who have 
Ph.D. degrees teach better than persons who do not. 


The relation of the credential to the world of work is being 
questioned for tle first time, and I suspect in the next five years 
there will be a major batter in the field of accreditation where 
"institutional legitimacy is concerned, and licensing where indi- 
vidual legitimacy is concerned. 24 
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The Academic Sieve:. A Need for Reform 


In addition, we’ve looked at the modus operandi of higher 
education institutions@pecially those “elites” who raise their 
status by rejecting people. When asked about the ranking of his/ 
her institions, many college or university deans will tell you the 
percentage of applicants who are rejected. Though that statistic is 
the measure of performance, it doesn’t say anything about what 
they did accept. It says simply, “we're so good, that we can let 
almost anybody go away and still maintain our viability as an insti- 
tution.” Research has since made such statements questionable. 


_ David McClelland, past president of the American Psychologi- 
cal Association ‘and professor at Harvard, looked at all of the studies 
in which people have tried to correlate grades in college with success 
in Jater life, using fourteen different criteria for success, some of 
which were income, philanthropic contributions, interest in com- 
munity affairs, and interest in the arts. Researchers had great dif- 
ficulty demonstrating that grades in school or college are related: 
in any other behavior of any importance whatsoever. It seems so 
self-evident to educators that those who do well in their classes 
must go on to do better in life that they systematically disregard 
evidence to the contrary. We educators believe that we prove our . 
worth when our students enter what many student cultures refer 
to as*‘the after life.” We think that the GPA will help them through 
adulthood. Unfortunately, the GPA’s meaning is often quite con- 
trary to a prediction of succes. It is not the straight “A” students 
in law school who necessarily become the most creative or famous 
lawyers. It is not the straight ‘‘A” students in medical school 


‘who become the most skillful, important or creative physicians. 
_We then have some problems in terms of what our system of 


evaluating people means in terms of what American society needs. 
That is another reason why the whole open leafning strategy 
begins to-be,so important. i . 

One final example. The chart on the following page (Figure 
10) shows a group of second grade students in a typical American 
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ACADEMIC ABILITY AND ACHIEVEMENT 
OF 26 SECOND GRADE STUDENTS 
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classroom, ranked a¢cording to their academic ability and achieve- te 


ment. ‘The double +s are the high standards and the straight lines - 
are the lows. Knowing this about them in second grade, one might 


‘expect. to be able to make some fairly accurate predictions about . - 


how long they will stay in the educational system, and where they 
will go. We expect that the ++s will go to selective four-year col- 
leges and universities, both public and private, and probably move 
~ on into managerial professional positions. The +’s will go to less" 
selective institutions, usually state colleges, will probably move at 
the mo3t, into lower-level managemanit-type positions., The 0’s, if 
‘they go at all, will go to. community. colleges and will be engaged 
‘in clerical and technical work. The —'s, obviously, are the dregs: 
‘of hau life. 


' ‘Now let’s joke at this same group of second. grade sidonts 
__ based on-‘some other characteristics that may be important for 
American life, including creativity, planning, communicating, 
forecasting, and decision-making.. (See Figure 11.). All of these * 
‘are measurable, and teachable.’ We know we can improve the 
ability of individuals on each of these traits. 


First of all, iiote how our high academics score on creativity 
‘measures—they are about the lowést people in the class. The high: 
_ Creatives are all at the bottom of the academic distribution. This 
_is true not just in-this class of 26 second graders, incidentally. 
Getsells and Jackson established that it is fairly true in a national... 
sample as well. On measures of Blanning, communicating, and - . 
forecasting, again, you find that the distribution.of talent ranges 
throughout the academic range; ‘The notion that we have creamed 
off the best from the top simply doesn’t work when other variables — 
are considered, especially i in relation to the world of work. Most 
important to me is the decision-making category. This not only 
> involves making decisions, but. making decisions that turn out to 
- be correct. On this s particular diniension, the, three best decision- 


makers are are the three lowest in academic ‘aptitude and achievement. 
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It seems to me, {hat for anybody who’s ever chaired a faculty meet- ~ 


* ing, ‘the truth of that just bursts upon you. 
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4 This little chart, then, indicates something i important about 

| the academic sieve: many people possessing varied talents are let 
through the sieve because the sieve doesn’t allow for the range of 
maleiit that i is needed by the American society. 


« “One final point about the ability we have to evaluate people’s 
worth. I’d like to mention briefly a study that, for me, epitomizes 
_ the strength of educational evaluation. A required “Introduction 
to Natural Science” course is taken by 1400 freshmen at a major - 
' state college. The students hate to take it because it is required, ; 
and they aren’t ‘interested in science anyway. The faculty don’t 
like to teach it because they don’t get any credit toward tenure for 
it, but on the other hand, this course subsidizes all the graduate 
| courses and research at, this particular institution. And, therefore, 

’ the faculty are vociferous in their defense of the course. In this -' 
_» experiment every section in the course was given a weekly exam. 
/ The section tests were rotated so that every week the evaluators 
. had some idea of where the learning for that particular week was 
~ and how far the students had moved. The results are interesting if 
you try to plot a mean learning curve for the semester (see Figure 
12). The first seven weeks: absolutely nothing. The students 


~ are clearly thinking about work and courses that interest them, * 


their major, the typical freshman curriculum, which has something 
to do. with liquor and the opposite sex. The mid-term, again, didn’t 
seem to turn anybody on; as a matter of fact, it was a disaster. In 
- week 10, all of the section people said'to ‘their students, “‘If you 


‘- “» don’t all get busy and study, you’re all going to flunk this course.’ 
oes ‘Now, B. F: ‘Skinner has told us that negative reinforcement never. 


leads to learning, but we have living proof that he’s wrong. Because © 
by the time the course is over, the resultant mean score is 68. , 
The faculty say, “Wow, 68, that’s really good.” And the first 

. question, 68 of what? And the answer was 68 of 100 of course. 


Well, then what’s 100? Ist all the material in the course?, Well...» 


of Course t not, we had to boil it down and just p put the important 
stuff in the final. Well, if that’s the important stuff, why did you 
teach the rest of it? . . . and so the discussion went. What happened 
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LEARNING PLUS FORGETTING CURVE, 
. NATIONAL SCIENCE REQUIRED COURSE, 
NON-MAJOR, ONE SEMESTER 


% of Material 
Learned * -% of Matetial 
‘¢ 100° 


next was that the students were followed for 16 more weeks after 
they were m longer taking the course to see how long it took them 
to forget the material that was put into their heads so painfully. 
And there’s a rernarkable parallel bet ween the slope of the learning - 
curve and the slope of the forgetting curve (see Figure 13). This 
little exercise cost the taxpayers of this state $145,000. And for 
their $145,000 what did they get? They got about 3’ weeks of . 
_,, knowledge out of 32. I think if I were a taxpayer of that state, I’d 
ks begin to ask some questions. Like, first of all} what should you ex- | 
pect in terms of student retention? Some very interesting ques- 
_tions are raised there. When this data was presented to the faculty, 
they felt, of course, that the course nevertheless ought to be 
- taught. Clearly their own work was involved, because they love to 
do the graduate courses that this course made possible. In addi- 
tion, they indicated that this material is absolutely vital because of 
the average American’s performance as a voter: You would have 
to.make.decisions on scientific policy, and this is why the course 
was important. Of course, if that’s true, all national elections. 
would have to be held between semestets because that’s the only 
time they remember it. 


Let’s think about some learning curves. When you learn to 
walk you generally keep on. It’s fun. Nobody hits you for it. 
You get rewarded for it occasionally. Walking is OK. Talking is 
the same kindof thing, as is reading, that once you learn, you tend 
‘to keep on. But consider for just a minute, the geography of Brazil. 
Most 10-year-olds are experts on the geography of Brazil. They 
knew the rivers, the tributaries, the climate, the capital city, the 
imports, the exports, the rainfall. I think you'd probably agree 
that the forgetting curve on that material is relatively shgrt. Sim- 
ilarly with division of fractions. So, one can raise sore new ques- 
tions about theeffectiveness of an education. How long should 
__.People retain material after they’v ve been exposed to it?. What is 
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“an efficient institution? What i is an effective institution? 
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. Figure 14 


The fact is, we can easily measure most of those things now 
if we want to, and can show quite conclusively exactly what the 
rate of retention is. A friend of mine who is a dean of 4 medical 

. school said that may be true for your undergraduates, but it cer- 
tainly isn’t true for professionals. So, we talked about that a 
+ little, and finally he bet that his first year students would remem- 
ber 85% of the material of the first year, if they were retested one 
.month after the end of the first year. So his first year class was re- 
~--~-tegted, and the scores showed that the freshman class remem 
* s 2a 
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45% of the material on the final exam. ~ Now again, I don’t know 

what that means when you consult your local family physician, 
but it did give us some new dimensions on what people ought to ’ 

| remember, and what an jnstitution should do if it calls itself a 

. College, a university, or a school. 


An Assessment of Needs 


There is another data set that is essential to consider in tefms 

'” of developing a national education research agenda. What per- 

' ceptions do 30-year-olds have about the world? Figure 16 shows 

| data from a group from the Project Talent data base. These sub- 
jects were 15-year-olds in 1960, and now they’re 30. They ¥ were 

asked to reflect on their lives as adults. “Health,” “spouse,” and 

“job satisfaction” were especially important,’ ‘and it was concluded 

that, according to this data, most people were satisfied with them. 

“Developing a mature understanding of life” was important and 

‘most people were relatively satisfied. But on “intellectual develop- ,' 

ment,” 84% thought it was very important and only 54% were 

satisfied with their intellectual os nt. Now one interpreta- 

- tion of that result is that some people have an enormous desire to be 

_ all things and know all things, but I don’t really think that’s the 
case. I think this statistic is a comment _ teaching. In addi- 
tion, the same survey indicated that vocatfonal guidance was ter- 

ribly inadequate both in high schools and in colleges. If I would 

make any recommendation today, it would be to establish good 

programs for training people in vocational counseling both for ~ 

high schools and colleges, as well as for the world of work. Voca- 

tional counseling involves personal sensitivity, the ability to listen « 

to people, the ability to provide them with accurate information. 

T have no data to support this contention, but I’m quite sure that 

a great deal of very inaccurate information is now being passed 

00 to students. There must be some way ‘to change that. In addi- 

“tion, the Hieslong learning market is really large.” There are eke 
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DATA FROM 1,000 30-YEAR-OLDS; 
15 YEARS AFTER PROJECT TALENT (1960) 


85% High school diploma (only 50% of their parents have it). 
25% Four-year college degree (only 10% of parents do). 


Quality of life items from data 


. Very Important Satisfied 


Item: Health 86% 
Spouse over 90% 82% 
Job oe 19% 

Children | 88% 82% 


: -Develop anature, 
personal understanding - 
oflife . 88% 12% 


Intellectual development 


‘million Americans who would go back to college or university,  * 

or other training institutions today if they only knew where to go. * - 
Many of the problems that institutions are having with deereasing 
enrollment could be solved if we could find ways of getting more | 
adults into colleges and universities and other settings. Indeed 

this is happening now. The community colleges have done an - 
excellent job in beginning to meet some of these new needs and 

they. will continue to do so in the future:-- However; when you hear*~** 
the rhetoric about the new students, they’re supposed to be women, _ 
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ethnic minorities, blue collar, unemployed. And then if you look 
at who they really are, you find that they’re white, male, middle 
- class, managerial backgrounds, full-time employed, some previous 
college experience. The group that’s actually ret&rning to eollege 
4s very much like the typical 18- to 21-year-old undergraduate. © 
They're just older. Their college was deferred for some reason: 
; marriage, military service, and now they're back. So we still are 
| * pot meeting the agenda that I outlined initially, which is meeting 
|} __ the educational needs of the poor, and racial and ethnic minorities, 
‘ both in terms of personal satisfaction and occupational success. 


In addition to the instructional services, I think it’s important. 
_ to remember that adult needs are seldom related to course work.‘ 
. \One particular survey shows that 48% of the adults wanted to take . 
\ acourse, 31% simply Mee to assess their personal competencies. 
They wanted to check their’pgrsonal growth and poten Twenty- 

- , eight percent simply wanted to check their strengths and weaknesses — 
in skills and subjects; they were nof interested in job and college : 
entry. And, most interesting for me is the fact that 20 percentof > — 
the sample, and it was a good random sample of the population, 
expressed, in a face-to-face interview, a need for personal counsel- 
ing. If one-fifth of the American adults feel a need for personal _ 
‘counseling, and will admit it face-to-face to an interviewer, a very 
real problem exists. And that problem will not be handled through 

. the establishment of conventional course work orconventional ~ 
patterns of faculty advising. Indeed, what we may have to think 
about is an alternative that, is not related to colleges and universities - 

, atall. It may be that we'll have to start thinking about “‘collection 
points” where adults normally congregate and begin developing a 

* program to make available to people in that setting certain kinds 

_ of highly skilled counselors who would be able to assess people’s 
needs, locate diagnostic centers which provide the needed services 
to assess their potential, what they ought to be doing, and then - 
refer them, if necessary. Such a program is currently in operation... 
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* in the state of New York, under the direction of Norm Kurland, 
and it seems to me that it’s a forerunner of the type of programs 
we will soon have to develop. ‘ 


In addition to that new kind of delivery system, we may have 
- to separate degrees fram credentials, due to the fact that though 
most degrees are not Idgitimate predictors of job success they’re 
used that way. If we separate degree granting and credentialling 
/ through a regional examining institute, we can meet the needs of 
all adults and do it well. Figure 17 is illustrative of the flexibility 
of such a credentialing system. Of the four individuals, the first 
has no college, requests certification as a computer programmer 
\ claiming he/she has the skill. That person can go directly to the ~ 
ional examining institute, and, having the necessary skills, 
he/she can be certified as a pfogrammer and can move directly to 
a job. Individual B has no college education, but wants credit for 
previous experience in order to be admitted into college eee 
advanced level. The REI grants the credit based on an analysis 
of previous experience, and the person goes into the college. 
Individual C has credits from various sources and wants to com- 
" bine those credits to fulfill degree requirements. (In one case in 
Berkeley we found one person who had 250 credits of the under: 

% graduate level and no degree because-no institution would recog- 
nize the credits from any other institutions he’d been to.) Again, 
‘the REI would have authority to combine the credits sothata 
degree would be granted. Individual D wants diagnostic counsel- 
ing only, not a degree or certificate. That person goes to the REI, 

_receives those services that he/she needs. There isn’t a college or 
university I know of, with the exception of perhaps one, that can 
meet the needs of all four individuals at the present time. 

‘ Now, finally, as we start thinking about who’s going to make 
it in the world of work, we have to ask some evaluation questions. 
There are only three that concern me. First, the criterion ques- 

--wieen-tion:What do we want people to be able to do?**The second is 

a standards question: “What level-of performance do we require? 
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How good is good enough?” And the third one is the technique 
question: “Are there ways to measure those things?” Knowing 
what we now know, it seems that since the competency-based 
programs greatly increased our specificity of criteria, we now can 
identify with some certitude what we want people to be able to 
do. I consider that a net gain, On the standards question, “How 
much is enough?” it séems to me we still have a long way to go. 
There is very little evidence that our standards are particularly 
related to the needs of society or to the needs of an individual. 
So the question of “How much is enough?” is the question which 
I think will preoccupy us in the next few years. The technique 
question i is all but over. That is, if you know what it is you're 


_ going to measure, there’ sa cane to measure it. 


Some who are in competency-based programs say, “That | 


. standards question doesn’t matter any more because we have -. 


defined competencies afid therefore we needn’t worry about 
standards.” Is that really true? In one particular area, when the 
question regagding criteria for high school graduation was pre- 
sented, some people thought everyone should kpow how a car - 
operates. One of the things you have to know if you are going to . 
work the car is how to change a tire. So a subcommittee was 


established to deal, in an hour or two, with this very simple prob- 


lem of deciding whether a person was a competent tire-changer. 
And this is what they came up with: first of all, does that mean =, 
that a person has to know how to change any tire on any car, or _, 
just their own? How about trucks, and bikes and motorcycles? #2 
Secondly, do they have to know how to use equipment like aix. * 
wrenches and hydraulic jacks? Do they have to know how to . 
ir leaks in tires, or do they put on the spare even if it’s flaty= 
ich 50,000 Americans do every year? Finally (and this is 
where the standards question comes in), they come up with the 
question of how much time one should allow to change the tire? 
A pit crew at Indianapolis takes two seconds; the average week- 
ender, if there’s no coronary involved, takes about 35 minutes. 
So standards came down to the ultimate decision of the amount 
of time one is allowed to accomplish the act. And it seems to me 
we need to rethink that a little bit because some people may be 
a little: ‘slower ahd may_do it a little better. - ; 
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"+ what they can do. Job training is not quite as good, and simula- . 


Tire changing—and yet, unieah we think it is simple, knowl- 
edgeable adults assigned to establish criteria for the task come up ~ 
“with more questions. And in the process they are quoting Thomas 

_ Jefferson, Paine, Roosevelt, and Lincoln. So, I think the issue 
’ of competency cannot be decided until we can answer those 

standards questions. ae a 


We do know quite a bit about what predicts success on the 
job, and it’s clear that the best way is probation, or work experi- 
-ence programs. You can evaluate a person on fhe job and find out 


"tion is even more inadequate. General traits and basic traits, 
‘verbal ability and figural relationships have the lowest predictabil- 
ist job success. However, notice that the tests we give most 

ten in colleges and universities are verbal and figural relation- 
ship, though we know they have the lowest job success relation- 
ship. There is evidence to believe that we need to seriously 
examine these evaluation procedures.. We also know a lot about 
- the kinds of skills that people ought to have. We know that they 
‘are working with “data” skills, “people” skills, and “things” 
skills, and that these can be arranged in order of difficulty and — 
- can be operationally defined so that they become part of the | 
public domain. 


- 


_ _T’m not saying that higher education ought to become voce: 
tionalized. I ayn saying that these skills are equally useful for the - 
. - liberal arts, and that we need to begin specifying the criteria 
a people should attain, whatever the objective. 


ye tried to outline a few of the i issues that. I think one. would* 

have to consider iri building a research and development agenda 

- . concerned with the relationship of education to work. I’ve covered 8 
_ Many aspects of the topic, and I hope that I’ve introduced ques- 


’, . ‘tions and issues which will challenge you to formulate ideas about _ 


what a research agenda ie to be, and then communicate those 
ideastous. 
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